Optimizing persistent random searches 
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We consider a minimal model of persistent random searcher with short range memory. We cal- 
culate exactly for such searcher the mean first-passage time to a target in a bounded domain and 
find that it admits a non trivial minimum as function of the persistence length. This reveals an 
optimal search strategy which differs markedly from the simple ballistic motion obtained in the 
case of Poisson distributed targets. Our results show that the distribution of targets plays a crucial 
role in the random search problem. In particular, in the biologically relevant cases of either a single 
target or regular patterns of targets, we find that, in strong contrast with repeated statements in the 
literature, persistent random walks with exponential distribution of excursion lengths can minimize 
the search time, and in that sense perform better than any Levy walk. 

PACS numbers: 



The random search problem addresses the question of 
determining the time it takes a searcher performing a 
random walk to find a target pQ. At the microscopic 
scale, search processes naturally occur in the context of 
chemical reactions, for which the encounter of reactive 
molecules is a required first step. An obvious historical 
example is the theory of diffusion — controlled reactions, 
which has regained interest in the last few years in the 
context of genomic transcription in cells [1 . Interest- 
ingly, the random search problem has also proved in the 
last decades to be relevant at the macroscopic scale, as in 
the case of animals searching for a mate, food, or shelter 

In all these examples, the time needed to discover a 
target is a limiting quantity, and consequently the min- 
imization of this search time often appears as essential. 
In this context Levy walks, which are defined as ran- 
domly reoriented ballistic excursions whose length I is 
drawn from a power law distribution P(l) oc l/7 1+/i 
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with < /i < 2, have been suggested as potential candi- 
dates of optimal strategies [5]. In fact, Levy walks have 
been shown mostly numerically to optimize the search 
efficiency, but only in the particular case where the tar- 
gets are distributed in space according to a Poisson law, 
and are in addition assumed to regenerate at the same 
location after a finite time. Conversely, in the case of a 
destructive search where each target can be found only 
once the optimal strategy proposed in [5] is not anymore 
of Levy type, but reduces to a trivial ballistic motion. 
Given these restrictive conditions of optimization, the 
potential selection by evolution of Levy trajectories as 
optimal search strategies is disputable, and in fact the 
field observation of Levy trajectories for foraging animals 
is still elusive and controversial [TU1 - H2"] . 

From the theoretical point of view, the search time 
can be quantified as the first-passage time of the ran- 
dom searcher to the target [13 . In the case of a single 
target in a bounded domain, or equivalently of infinitely 
many regularly spaced targets, asymptotic results for the 



mean first-passage time (MFPT) and the full distribution 
of the first-passage time have been obtained for Marko- 
vian scale invariant random walks |14[ 115] . These re- 
sults apply in particular directly to Brownian particles 
that are subject to thermal fluctuations, and therefore 
to diffusion-limited reactions in general. At larger scales 
however, most examples of searchers - even if random - 
have at least short range memory skills and show per- 
sistent motions, as is the case for bacteria [TB] or larger 
organisms [2], which cannot be described as Markovian 
scale invariant processes. The study of persistent random 
walks therefore appears as crucial to assess the efficiency 
of many search processes, and has actually also proved 
to be important in various fields such as neutron or light 
scattering [T7HI9] . In this context exact results have been 
derived that characterize the diffusion properties of per- 
sistent walks in infinite space |19H21j . or mean return 
times in bounded domains [17j [18j |22l [23]. The ques- 
tion of determining first-passage properties of persistent 
walks has however remained unanswered so far. 
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FIG. 1: (Color online) Example of search trajectory for a 
persistent random searcher in a bounded domain. 

In this paper, we consider a minimal model of per- 
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sistent random searcher - called persistent random walk 
model hereafter - with short range memory character- 
ized by an exponential distribution of the length of its 
successive ballistic excursions P(l) oc e - "'/'*, where 

Ip is the persistence length of the walk and a a numeri- 
cal factor. We calculate exactly for such persistent ran- 
dom walker the MFPT to a target in a bounded domain, 
which corresponds implicitly to the case of a destructive 
search since the target can be discovered only once, and 
find that it admits a non trivial minimum as a function 
of l p , thus revealing an optimal search strategy which is 
very different from the simple ballistic motion obtained in 
the case of Poisson distributed targets. In addition, we 
show numerically that such optimal persistent random 
walk strategy is more efficient than any Levy walk of 
parameter /i e]0, 2[. Together, our results show that the 
distribution of targets plays a crucial role in the random 
search problem. In particular, in the biologically rele- 
vant cases of either a single target or patterns of targets 
characterized by a peaked distribution of the target to 
target distance [2], we find that, in marked contrast with 
repeated statements in the literature, persistent random 
walks with exponential distribution of excursion lengths 
can minimize the search time, and in that sense perform 
better than any Levy walk. 

The model is defined as follows (see Fig. 0). We 
consider a persistent random walker in discrete time and 
space, moving on a <i-dimensional cubic lattice C of vol- 
ume V = X d , where a single target site is located. In 
practice we take d — 2 or d — 3, make use of peri- 
odic boundary conditions and consider the dilute regime 
X ^> 1. This geometry encompasses both cases of a 
single target centered in a confined domain, and of reg- 
ularly spaced targets in infinite space with concentra- 
tion l/V. The latter situation can be seen as a limiting 
case of target distribution with strong correlations, as 
opposed to the Poissonian case, and is biologically mean- 
ingful for example in the case of repulsive interactions 
between targets [2J. The case of a target of arbitrary 
position in a domain with reflective boundary conditions 
can also be solved exactly using similar techniques and 
has been checked to yield analogous results; analytical 
expressions are however much more complicated in this 
case and are omitted here for clarity. Note that here 
the lattice step size corresponds to the target size and is 
set to 1, which defines the unit length of the problem. 
At each time step, the random searcher has a probabil- 
ity pi to continue in the same direction, p2 to go back- 
ward, and P3 to choose an orthogonal direction, so that 
p 3 = (1 — pi — p 2 )/(2d~ 2). Following [2D], we denote 
Pi = P3 + e an d Pi = P3 — S, and set in what follows 5 = 
for the sake of simplicity. The probability of a ballistic 
excursion of I consecutive steps with unchanged direction 
is then P(l) = (1 — pi)p{~ 1 , and the persistence length of 
the walk can be defined as l p = YaZi ^(0 = 1/(1 — -Pi) 
where p\ = (1 + (2d — l)e)/(2d), so that eventually 
l p = (2d/(2d — 1))/(1 — e). In what follows we calcu- 
late analytically the search time (T) , defined here as the 



MFPT to the target averaged over all possible starting 
positions and velocities of the searcher, and analyze its 
dependence on the persistence length l p (or equivalently 
e) and the volume X d . 

While the position process alone is non Markovian, the 
joint process of the position and velocity of the searcher is 
Markovian. One can therefore derive an exact backward 
equation for the MFPT T(r, e^) to the target of position 
tt, for a random searcher starting from r with initial 
velocity ej, where B — {ei, . . . , e^} defines a basis of the 
lattice : 



T(r, ei ) = piT(r + e it e 4 ) + p 2 T(r - e u -ej) 



(1) 



Note that this equation holds for all sites r ^ r^. Indeed, 
by definition for r = yt the lhs of of Eq. ([IJ yields 
T(rr,ej) = 0, while the rhs gives the mean return time 
to site tt, which is exactly equal to V in virtue of a 
theorem due to Kac [23]. We next introduce the Fourier 

transform /(q) = J2reC /( r ) e_Jq ' r 01 a function /(r), 
where q L = 2-KUi/X with rij € [0,X — 1]. The Fourier 
transform of Eq.Q, completed by the above discussed 
result at r = yt then yields : 

f (q,e 4 ) + Ve-^ r - = eT^e^e^ + V5(q) +p 3 ff(q) 

(2) 

where 

g(q) = Y, (T^e,)^ + T(q, -e^e"^) , (3) 

and <5(q) is the d-dimensional Kronecker function. We 
thus obtain: 

1 — ee 4qe ' 

Summing Eq.Q times e lq ei over all e, yields a closed 
equation for g(q), which is solved by: 



<7(q) = 



7 (q,i)y(i(q)-e-'^) 
1 -P3j(q, e) 



where 



7 (q, £ ) = 2^ - 



cos(q.ej) — e 
- e 2 — 2e cos(q.ej) 



(5) 



(6) 



Substituting this expression of g(q) in Eq.Q then leads 

to an explicit expression of T(q, e^). After Fourier in- 
version and averaging over all possible starting positions 
and velocities we finally obtain after some algebra: 



-e(V-l) 1 + e 



I - e 



I - e 2 ^ I - hi 



q#0 



- h(q, e) 



(7) 
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where 



h(q, e) 



{e-lf 



cos(q.ej) 
e 2 — 2ecos(q.ej) 



(8) 



and Sq^o denotes the sum over all possible vectors q 
defined above except q = 0. This exact expression of the 
search time for a non Markovian searcher constitutes the 
central result of this paper. We discuss below its physical 
implications, based on two useful approximations. 

We first consider the case where e C 1, which implies 
that the persistence length is of the same order as the 
target size (l p — 0(1)). In this regime the search time 
reads: 



(T) = A(e,V)(V 



1 



1 



D(e) 



(9) 



where (T) is the search time of a non persistent random 
walk (e = 0) which is known exactly [25 . The quantity 
A(e, V) writes A(e,V) = (B d (V) - l)e + C(e 2 ) where 
Bd{V) depends on V as follows: 



B d {V) 



2 
V 



I V - 

- 2^ (1 - cos(27rq.ej))' 



E 



(10) 



- 1 — cos(27rq.ej^ 



e,ee 



In the dilute regime (V — > oo), Bd has a finite limit 
(for example B 2 — 2.72) and Eq.Q provides a use- 
ful approximate of the search time. In this expression, 
D(e) = (1 + e)/(l — e) is the diffusion coefficient of the 
persistent random walk normalized by the diffusion coef- 
ficient of the non persistent walk (case e = 0) [20]. Hence, 
in Eq. ( 11 ), (T)q/D is the search time expected for a non 



persistent random searcher of same normalized diffusion 
coefficient D. Note that the persistence property yields a 
non trivial additive correction which scales linearly with 
the volume, and therefore should not be neglected; this 
could be related to the "residual" mean first passage time 
described in |26j . As shown in Fig. [2j the approximation 
of Eq. ([9| is accurate as long as l p is small (that is e <C 1). 

We next consider the case where the persistence length 
is much larger than the target size, that is l p ^> 1, or 
equivalently e — > 1. In this regime the search time reads 
in the case d = 2 : 



2(X-1) {X-lf 



1 - e 



(1 



(X-l)(X + 3)(X-2) 
12 



(11) 

+ G((l-e) 2 ). 



Fig. [2]shows that this expression provides a good approx- 
imation of the exact result of Eq. Q for l p 3> 1. Note 
that the search time diverges for l p — > oo (or e — > 1) be- 
cause the searcher can then be trapped in extremely long 
unsuccessful ballistic excursions. 




FIG. 2: (Color online) Search time for a 2-dimensional persis- 
tent random walker (T) normalized by the search time for a 
non persistent walker ((T)o) as a function of the rescaled per- 
sistence length, for X — 10 (upper set of curves) and X — 100 
(lower set of curves). The red line stands for the exact result 
of Eq. |7|, the dotted lines for the approximation e < 1 of 
Eq. the dashed lines for the approximation e — > 1 of Eq. 
|Tlj). We used the identity l p = (2d/(2d - 1))/(1 - e). 
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FIG. 3: (Color online) Optimal search time scaled by the non 
persistent case as the function of the domain volume V for 
d — 2. The black line stands for the numerical optimization 
of Eq. Q, the red line for the analytical optimization of 
Eq. and the green dashed line for a fit A/ln(V), where 

we used the identity l p = (2d/(2d- 1))/(1 - e). Inset: The 
black line stands for the persistence length at the minimum, 
l* y obtained by a numerical optimization of Eq. |7|, as a 
function of X. The dashed red line is a linear fit of this curve 
{l p ~ 0.14 X + 3.6). 



Both asymptotics e — > and e — > 1 clearly show that 
the search time can be minimized as a function of e or 
equivalently l pi as seen in Fig. [2| The minimum can be 
obtained from the analysis of the exact expression d7]), 
and reveals that the search time is minimized in the case 



2 for L = I* 



x- 



X 2 X with A 2 ~ 0.14.... Note that 
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the asymptotic expression (11) yields a good analytical 



approximate of this minimum. This defines the optimal 
strategy for a persistent random searcher, which is real- 
ized when the persistence length has the same order of 
magnitude as the typical system size. In particular, for 
large system sizes the optimal persistence length becomes 
much larger than the target size. We stress however that 
the numerical factor A is non trivial and notably small. 
This optimal strategy can be understood as follows. In 
the regime l p <C X, the random walk behaves as a regular 
diffusion and is therefore recurrent for d = 2. The explo- 
ration of space is therefore redundant and yields a search 
time that scales in this regime as VlnV [57]. On the 
contrary for l p 3> 1 exploration is transient at the scale 
of l p and therefore less redundant. As soon as l p ~ X one 
therefore expects the search time to scale as V |17j . Tak- 
ing l p too large however becomes unfavorable since the 
searcher can be trapped in extremely long unsuccessful 
ballistic excursions, so that one indeed expects an opti- 
mum in the regime l p ~ X. This argument suggests the 
following scaling of the optimal search time scaled by the 
non persistent case in the case d = 2 : 



(T) 
(T)o 



p - cx 1/HV), 



(12) 



which can indeed be derived from the asymptotic expres- 
sion (11) (see also Fig. [3]). This shows the efficiency of 
the optimal persistent search strategy in the large vol- 
ume limit, as compared to the non persistent Brownian 
strategy. Note that for d = 3a similar analysis applies. 
In particular the search time is minimized for a value of 
the persistence length that again grows linearly with the 
system size I* ~ A3X with however a slightly different 

X— ¥00 

numerical value of the coefficient A3 ~ 0.12.... Addition- 
ally, since for d = 3 one has (T)o oc V, the scaled optimal 
search time then tends to a constant. 

Last, we compare the efficiency of the persistent and 
Levy walk strategies. More precisely we consider a Levy 
walker such that the distribution of the length of its suc- 
cessive ballistic excursions follows a symmetric Levy law 
of index /1 and scale parameter c restricted to the positive 
axis, defined by the Fourrier transform P(k) = e~ c l fe l M , 

so that P{1) cx 1// 1+M . For < /j, < 1, the persistence 

I— ¥00 

length is infinite, yielding in turn an infinite search time. 
We therefore focus on the regime 1 < /1 < 2 and study 



numerically the dependence of the search time on both 
H and l p (which is set by c) . Figure [4] shows that the 
search time can be minimized as a function of l p for all 
\x g]1,2], and that this optimal value decreases when fj, 
is increased. In particular the search time for the Levy 
strategy is minimized when fi = 2, i-e when the length 
of the ballistic excursions has a finite second moment so 
that the walk is no longer of Levy type. As seen in Fig. 
[4] the optimal persistent random walk strategy therefore 
yields a search time shorter than any Levy walk strategy. 

This optimal persistent search strategy is in marked 
contrast with the simple ballistic motion obtained in the 




FIG. 4: (Color online) Numerical computation of the search 
time for a Levy walk on a 2D lattice (X = 50). Plots with 
circles stand for the search time for the following values of fj, 
(from top to bottom): fx = 1.2, 1.4, 1.6, 1.8 and 2. The black 
line stands for a persistent random walk for several values of 
e. The abscissa stands for the persistence length l p , function 
of c or e. 



case of Poisson distributed targets, and shows that the 
distribution of targets plays a crucial role in the random 
search problem. In particular, in the biologically relevant 
cases of either a single target or patterns of targets char- 
acterized by a peaked distribution of the target to target 
distance, we find that, as opposed to repeated statements 
in the literature, persistent random walks with an expo- 
nential distribution of excursion lengths can minimize the 
search time, and in that sense perform better than any 
Levy walk. 
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